What will RLHF-based PaLM apps be able to accomplish? With the model's expanding scale, performance across all activities keeps becoming better, creating more opportunities. Up to 540 billion parameters can be used with PaLM. Comparatively, GPT-3 only has about 175. The first open source ChatGPT equivalent appears to have appeared.

The first open-source equivalent of OpenAI's ChatGPT has arrived, but good luck running it on your laptop -- or at all. This week, Philip Wang, the developer responsible for reverse-engineering closed-sourced AI systems including Meta's Make-A-Video, released PaLM RLHF, a text-generating model that behaves similarly to ChatGPT. The system combines PaLM, a large language model from Google, and a technique called Reinforcement Learning with Human Feedback -- RLHF, for short -- to create a system that can accomplish pretty much any task that ChatGPT can, including drafting emails and suggesting computer code. That is to say, the system hasn't been trained on the example data from the web necessary for it to actually work. Downloading PaLM RLHF won't magically install a ChatGPT-like experience -- that would require compiling gigabytes of text from which the model can learn and finding hardware beefy enough to handle the training workload.